Abstract
The Behavior Rating Inventory of Executive Functions (BRIEF) screens for executive function deficits in 5- to 18-year-olds. Data of three autism subgroups, according to DSM-IV-TR criteria (N = 35 Autistic Disorder, N = 27 Asperger’s Disorder and N = 65 PDD-NOS), were analyzed. The total group has elevated scores on almost all BRIEF scales. The Shift scale is clinically elevated, reflecting a deficit in cognitive flexibility. The BRIEF scales are not found to discriminate among the autism spectrum disorder (ASD) subgroups. The relation between BRIEF and IQ is complex. Possible influencing factors are discussed. Finally, it is recommended to omit the Negativity scale as a validity index in children with ASD and to consider a high score on this index as a unique characteristic of their BRIEF profile, reflecting rigidity problems.
Similar content being viewed by others
Notes
Such a reference group has also been used by Tsatanis et al. (2010).
In almost 40 % of the cases, there was a significant discrepancy between VIQ and PIQ. In those cases, according to the WISC-III manual, full scale IQ (FSIQ) is not meaningful. Omitting these cases from the study would result in a very select sample that would also be non-representative of children with ASD. Therefore, only VIQ and PIQ are used in the analyses; FSIQ is excluded as a variable.
Only PIQ was taken into account, since there are no significant correlations between the BRIEF scales and VIQ (see ‘Relation between IQ and EF’).
The chance of finding a significant correlation (α = .05) for PIQ and inhibition in the subset of BRIEF T-scores ≥ 65, under the null hypothesis of no association between both, is negligible (p = 0.01; based on Monte Carlo analysis, with 10,000 random permutations). The chance of finding three or more statistically significant (α = .05) correlations for PIQ in the subset of BRIEF T-scores < 65, under the null hypothesis of no association between PIQ and BRIEF scales, is negligible (p < .001; based on Monte Carlo analysis, with 10,000 random permutations).
The chance of finding these statistically significant (α = .05) correlations for PIQ > VIQ, under the null hypothesis of a similar association of PIQ > VIQ and PIQ < VIQ with the BRIEF scales, is negligible (p = .002; based on Monte Carlo, 10,000 random permutations).
References
Aarnoudse-Moens, C. S. H., Smidts, D. P., Oosterlaan, J., Duivenvoorden, H. J., & Weisglas-Kuperus, N. (2009). Executive function in very preterm children at early school age. Journal of Abnormal Child Psychology, 37, 981–993. doi:10.1007/s10802-009-9327-z.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author. doi:10.1176/appi.books.9780890423349.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.
Ardila, A., Pineda, D., & Rosselli, M. (2000). Correlation between intelligence test scores and executive function measures. Archives of Clinical Neuropsychology, 15, 31–36. doi:10.1016/S0887-6177(98)00159-0.
Arffa, S. (2007). The relationship of intelligence to executive function and non-executive function measures in a sample of average, above average, and gifted youth. Archives of Clinical Neuropsychology, 22, 969–978. doi:10.1016/j.acn.2007.08.001.
Bernstein, J. H., & Waber, D. P. (2007). Executive capacities from a developmental perspective. In L. Meltzer (Ed.), Executive function in education: From theory to practice (pp. 39–54). New York: Guilford Press.
Biederman, J., Petty, C. R., Fried, R., et al. (2008). Discordance between psychometric testing and questionnaire-based definitions of executive function deficits in individuals with ADHD. Journal of Attention Disorders, 12, 92–102. doi:10.1177/1087054707305111.
Birney, D. P., Bowman, D. B., & Pallier, G. (2006). Prior to paradigm integration, the task is to resolve construct definitions of gF and WM. Behavioral and Brain Sciences, 29, 127. doi:10.1017/S0140525X06319036.
Black, D., Wallace, G., Sokoloff, J., & Kenworthy, L. (2009). Brief report: IQ split predicts social symptoms and communication abilities in high-functioning children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(11), 1613–1619. doi:10.1007/s10803-009-0795-3.
Blair, C. (2006). How similar are fluid cognition and general intelligence? A developmental neuroscience perspective on fluid cognition as an aspect of human cognitive ability. Behavioral and Brain Sciences, 29, 109–160. doi:10.1017/S0140525X06319036.
Bramham, J., Ambery, F., Young, S., Morris, R., Russel, A., Xenitidis, K., et al. (2009). Executive functioning differences between adults with attention deficit hyperactivity disorder and autistic spectrum disorder in initiation, planning and strategy formation. Autism, 13, 245–264. doi:10.1177/1362361309103790.
Bryson, S. E. (1996). Brief report: Epidemiology of autism. Journal of Autism and Developmental Disorders, 26, 165–168. doi:10.1007/BF02172005.
Burgess, G. C., Braver, T. S., & Gray, J. R. (2006). Exactly how are fluid intelligence, working memory, and executive function related? Cognitive neuroscience approaches to investigating the mechanisms of fluid cognition. Behavioral and Brain Sciences, 29, 128–129. doi:10.1017/S0140525X06319036.
Christ, S. E., Holt, D. D., White, D. A., & Green, L. (2007). Inhibitory control in children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 37, 1155–1165. doi:10.1007/s10803-006-0259-y.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Constantino, J. N., & Gruber, C. P. (2012). Social Responsiveness Scale, second edition (SRS-2). Los Angeles, CA: Western Psychological Services.
De Bildt, A., de Jonge, M., Lord, C., Rutter, M., Dilavore, P., & Risi, S. (2008). ADOS Autisme diagnostisch observatie schema [ADOS Autism Diagnostic Observation Schedule]. Amsterdam, the Netherlands: Hogrefe.
Delis, D. C., Lansing, A., Houston, W. S., Wetter, S., Han, S. D., Jacobson, M., et al. (2007). Creativity lost: The importance of testing higher-level executive functions in school-age children and adolescents. Journal of Psychoeducational Assessment, 25, 29–40. doi:10.1177/0734282906292403.
Duncan, J., Schramm, M., Thompson, R., & Dumontheil, I. (2012). Task rules, working memory, and fluid intelligence. Psychonomic Bulletin & Review, 19, 864–870. doi:10.3758/s13423-012-0225-y.
Emslie, H., Wilson, F. C., Burden, V., Nimmo-Smith, I., & Wilson, B. A. (2003). Behavioural assessment of the dysexecutive syndrome for children (BADS-C). London: Harcourt Assessment.
Friedman, N., Miyake, A., Corley, R. P., Young, S. E., DeFries, J. C., & Hewitt, J. K. (2006). Not all executive functions are related to intelligence. Psychological Science, 17, 172–179. doi:10.1111/j.1467-9280.2006.01681.x.
Geurts, H. M., Begeer, S., & Stockmann, L. (2009a). Brief report: Inhibitory control of socially relevant stimuli in children with high functioning autism. Journal of Autism and Developmental Disorders, 39, 1603–1607. doi:10.1007/s10803-009-0786-4.
Geurts, H. M., & Bringmann, L. F. (2010). Planningsvaardigheden bij autisme spectrum stoornissen [Planning abilities in autism spectrum disorders]. Wetenschappelijk Tijdschrift Autisme, 9, 4–17.
Geurts, H. M., Corbett, B., & Solomon, M. (2009b). The paradox of cognitive flexibility in autism. Trends in Cognitive Science, 13, 74–82. doi:10.1016/j.tics.2008.11.006.
Geurts, H. M., Verté, S., Oosterlaan, J., Roeyers, H., & Sergeant, J. A. (2004). How specific are executive functioning deficits in attention deficit hyperactivity disorder and autism? Journal of Child Psychology and Psychiatry, 45, 836–854. doi:10.1111/j.1469-7610.2004.00276.x.
Gilliam, J. (2006). GARS-2: Gilliam Autism Rating Scale-second edition. Austin, TX: PRO-ED.
Gilotty, L., Kenworthy, L., Sirian, L., Black, D. O., & Wagner, A. E. (2002). Adaptive skills and executive function in autism spectrum disorders. Child Neuropsychology, 8, 241–248. doi:10.1076/chin.8.4.241.13504.
Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworhty, L. (2000). Behavior rating inventory of executive function (BRIEF): Professional manual. Lutz, FL: Psychological Assessment Resources.
Gioia, G. A., Isquith, P. K., Kenworthy, L., & Barton, R. M. (2002). Profiles of everyday executive function in aquired and developmental disorders. Child Neuropsychology, 8, 121–137. doi:10.1076/chin.8.2.121.8727.
Goldberg, M. C., Mostowsky, S. H., Cutting, L. E., Mahone, E. M., Astor, B. C., Denckla, M. B., et al. (2005). Subtle executive impairment in children with autism and children with ADHD. Journal of Autism and Developmental Disorders, 35, 279–293. doi:10.1007/s10803-005-3291-4.
Goldstein, S., & Naglieri, J. A. (2010). Autism Spectrum Rating Scales (ASRS): technical manual. Toronto: Multi-Health Systems Inc.
Granader, Y., Hardy, K. K., Yerys, B. E., Wallace, G. L., Lawson, R. A., Rosenthal, M., et al. (2013, May). Factor structure of the behavior rating inventory of executive function in children with autism spectrum disorders. Poster session presented at the International Meeting for Autism Research, San Sebastián, Spain.
Härdle, W. (1991). Smoothing techniques: With implementation in S. New York, NY: Springer.
Heitz, R. P., Redick, T. S., Hambrick, D. Z., Kane, M. J., Conway, A. R. A., & Englea, R. W. (2006). Working memory, executive function, and general fluid intelligence are not the same. Behavioral and Brain Sciences, 29, 135–136. doi:10.1017/S0140525X06319036.
Hill, E. L. (2004a). Evaluating the theory of executive dysfunction in autism. Developmental Review, 24, 189–233. doi:10.1016/j.dr.2004.01.001.
Hill, E. L. (2004b). Executive dysfunction in autism. Trends in Cognitive Sciences, 8, 26–32. doi:10.1016/j.tics.2003.11.003.
Hill, E. L., & Frith, U. (2003). Understanding autism: Insights from mind and brain. In U. Frith & E. L. Hill (Eds.), Autism: Mind and brain (pp. 1–19). New York, NY: Oxford University Press.
Huizinga, M., & Smidts, D. P. (2011). Age-related changes in executive function: A normative study with the Dutch version of the behavior rating inventory of executive function (BRIEF). Child Neuropsychology, 17, 51–66. doi:10.1080/09297049.2010.509715.
Jester, J. M., Nigg, J. T., Puttler, L. I., Long, J. C., Fitzgerald, H. E., & Zucker, R. A. (2009). Intergenerational transmission of neuropsychological executive functioning. Brain and Cognition, 70, 145–153. doi:10.1016/j.bandc.2009.01.005.
Kalbfleisch, M. L., & Loughan, A. R. (2012). Impact of IQ discrepancy on executive function in high-functioning autism: Insight into twice exceptionality. Journal of Autism and Developmental Disorders, 42, 390–400. doi:10.1007/s10803-011-1257-2.
Kenworthy, L., Black, D. O., Harrison, B., della Rossa, A., & Wallace, G. L. (2009). Are executive control functions related to autism symptoms in high-functioning children? Child Neuropsychology, 15, 425–440. doi:10.1080/09297040802646983.
Kenworthy, L. E., Black, D. O., Wallace, G. L., Ahluvalia, T., Wagner, A. E., & Sirian, L. M. (2005). Disorganization: The forgotten executive dysfunction in high-functioning autism (HFA) spectrum disorders. Developmental Neuropsychology, 28, 809–827. doi:10.1207/s15326942dn2803_4.
Kenworthy, L., Yerys, E., Gutermuth Anthony, L., & Wallace, G. L. (2008). Understanding executive control in autism spectrum disorders in the lab and in the real world. Neuropsychological Review, 18, 320–338. doi:10.1007/s11065-008-9077-7.
Kort, W., Schittekatte, M., Bosmans, M., Compaan, E. L., Dekker, P. H., Vermeir, G., & Verhaeghe, P. (2005). WISC-III NL, Nederlandse bewerking en handleiding, D.Wechsler [Dutch version and manual of the WISC-III]. London: The Psychological Corporation.
Krug, D. A., Arick, J. R., & Almond, P. J. (2007). Autism screening instrument for educational planning—Third edition (ASIEP-3). Los Angeles, CA: Western Psychological Services.
Lemon, J. M., Gargaro, B., Enticott, P. G., & Rinehart, N. J. (2011). Brief report: Executive functioning in autism spectrum disorders: A gender comparison of response inhibition. Journal of Autism and Developmental Disorders, 41, 352–356. doi:10.1007/s10803-010-1039-2.
Lewis, V., & Boucher, J. (1991). Skill, content and generative strategies in autistic children’s drawings. British Journal of Developmental Psychology, 9, 393–416. doi:10.1111/j.2044-835X.1991.tb00885.x.
Lopez, B. R., Lincoln, A. J., Ozonoff, S., & Lia, Z. (2005). Examining the relationship between executive functions and restricted, repetitive symptoms of autistic disorder. Journal of Autism and Developmental Disorders, 35, 445–460. doi:10.1007/s10803-005-5035-x.
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Jr, Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule-generic: A standard measure of social and communicative deficits associated with the spectrum of autism. Journal of Autism Developmental Disorders, 30, 205–223. doi:10.1023/A:1005592401947.
Manly, T., Robertson, I. H., Anderson, V., & Nimmo-Smith, I. (1999). The test of everyday attention for children (TEA-Ch). Bury St. Edmonds: Thames Valley Test Company.
Molenaar, P. C. M., & Campbell, C. G. (2009). The new person-specific paradigm in psychology. Current Directions in Psychological Science, 18(2), 112–117.
Newschaffer, C. J., Croen, L. A., Daniels, J., Giarelli, E., Grether, J. K., Levy, S. E., et al. (2007). The epidemiology of autism spectrum disorders. Annual Review Public Health, 28, 235–258. doi:10.1146/annurev.publhealth.28.021406.144007.
Ozonoff, S. (1997). Components of executive function in autism and other disorders. In J. Russell (Ed.), Autism as an executive disorder (pp. 179–211). New York, NY: Oxford University Press.
Ozonoff, S., & Jensen, J. (1999). Brief report: Specific executive function profiles in three neurodevelopmental disorders. Journal of Autism and Developmental Disorders, 29, 171–177. doi:10.1023/A:1023052913110.
Pennington, B. F., & Ozonoff, S. (1996). Executive functions and developmental psychopathology. Journal of Child Psychology and Psychiatry and Allied Disciplines, 37, 51–87. doi:10.1111/j.1469-7610.1996.tb01380.x.
Rajendran, G., & Mitchell, P. (2007). Cognitive theories of autism. Developmental Review, 27, 224–260. doi:10.1016/j.dr.2007.02.001.
Rakotomalala, R. (2011). Retrieved from http://eric.univ-lyon2.fr/~ricco/tanagra/en/tanagra.html.
Rattazzi, A., & Tripicchio, P. (2010, May). Anxiety, depressive and dysexecutive symptoms in a group of children and adolescents with Asperger’s disorder. Poster session presented at the International Meeting for Autism Research, Philadelphia, PA.
Rosenthal, M., Wallace, G. L., Lawson, R., Wills, M. C., Dixon, E., Yerys, B. E., et al. (2013). Impairments in real-world executive function increase from childhood to adolescence in autism spectrum disorders. Neuropsychology, 27, 13–18. doi:10.1037/a0031299.
Roth, R. M., Isquith, P. K., & Gioia, G. A. (2005). Behavior rating inventory of executive function—Adult version (BRIEF-A): Professional manual. Lutz, FL: Psychological Assessment Resources.
Russell, J. (1997). How executive disorders can bring about an adequate theory of mind. In J. Russell (Ed.), Autism as an executive disorder (pp. 256–304). Oxford: Oxford University Press.
Russell, J. (2002). Cognitive theories of autism. In J. E. Harrison & A. M. Owen (Eds.), Cognitive deficits in brain disorders (pp. 295–323). London: Martin Dunitz.
Russell, J., Hala, S., & Hill, E. L. (2003). Mechanising an executive task: The performance of preschool children, children with autism and with moderate learning difficulties in the automated windows task. Cognitive Development, 18, 111–137. doi:10.1016/S0885-2014(02)00163-6.
Russell, J., & Jarrold, C. (1998). Error-correction problems in autism: Evidence for a monitoring impairment. Journal of Autism and Developmental Disorders, 28, 177–188. doi:10.1023/A:1026009203333.
Russell, J., & Jarrold, C. (1999). Memory for actions in children with autism: Self versus other. Cognitive Neuropsychiatry, 4, 303–331. doi:10.1080/135468099395855.
Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). Childhood Autism Rating Scale, Second edition (CARS-2). Los Angeles, CA: Western Psychological Services.
Simonoff, J. S. (1996). Smoothing methods in statistics. New York, NY: Springer.
Sinzig, J., Morsch, D., Bruning, N., Schmidt, M. H., & Lehmkuhl, G. (2008). Inhibition, flexibility, working memory and planning in autism spectrum disorders with and without comorbid ADHD-symptoms. Child and Adolescent Psychiatry and Mental Health, 2, 2–4. doi:10.1186/1753-2000-2-4.
Smidts, D., & Huizinga, M. (2009). BRIEF, executieve functies gedragsvragenlijst, handleiding [BRIEF, behavior rating inventory of executive function, professional manual]. Amsterdam, the Netherlands: Hogrefe.
Spek, A. A. (2010). Cognitive profiles of adults with high functioning autism (HFA) and Asperger syndrome (Doctoral dissertation, Leiden University).
Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54, 131–143. doi:10.1111/jcpp.12001.
Tsatanis, K., Tirrel, J., Levine, M., & Ventola, P. (2010, May). Executive functioning profiles in children with ASD. Poster session presented at the International Meeting For Autism Research, Philadelphia, PA.
Turner, M. (1997). Towards an executive dysfunction account of repetitive behaviour in autism. In J. Russell (Ed.), Autism as an executive disorder (pp. 57–100). Oxford: Oxford University Press.
Turner, M. (1999). Generating novel ideas: Fluency performance in high-functioning and learning disabled individuals with autism. Journal of Child Psychology and Psychiatry, 40, 189–201. doi:10.1111/1469-7610.00432.
Van Aken, L., Kessels, R. P. C., Wingbermühle, E., Wiltink, M., van der Heijden, P. T., & Egger, J. I. M. (2014). Exploring the incorporation of executive functions in intelligence testing: Factor analysis of the WAIS-III and traditional tasks of executive functioning. International Journal of Applied Psychology, 4, 73–80. doi:10.5923/j.ijap.20140402.05.
Ventola, P., Levine, M., Tirrel, J., & Tsatsanis, K. (2010, May). Relationship between executive functioning, autistic symptomatology, and adaptive behavior. Poster session presented at the International Meeting For Autism Research, Philadelphia, PA.
Verté, S., Geurts, H. M., Roeyers, H., Oosterlaan, J., & Sergeant, J. A. (2006). Executive functioning in children with an autism spectrum disorder: can we differentiate within the spectrum? Journal of Autism and Developmental Disorders, 36, 351–372. doi:10.1007/s10803-006-0074-5.
Wood, R. L., & Liossi, C. (2007). The relationship between general intellectual ability and performance on ecologically valid executive tests in a severe brain injury sample. Journal of the International Neuropsychological Society, 13, 90–98. doi:10.1017/S1355617707070129.
Yeargin-Allsopp, M., Rice, C., Karapurkar, T., Doernberg, N., Boyle, C., & Murphy, C. (2003). Prevalence of autism in a US metropolitan area. Journal of American Medical Association, 289, 49–55. doi:10.1001/jama.289.1.49.
Acknowledgments
We would like to thank all children and their parents for participating, and M. Heeren, L. Voerman, J. Havinga, P. Mulder and J. van Olffen for their help in data processing.
Conflict of interest
The authors declare that they have no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Blijd-Hoogewys, E.M.A., Bezemer, M.L. & van Geert, P.L.C. Executive Functioning in Children with ASD: An Analysis of the BRIEF. J Autism Dev Disord 44, 3089–3100 (2014). https://doi.org/10.1007/s10803-014-2176-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-014-2176-9